This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 



BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of the 
original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 



BLACK BORDERS 

TEXT CUT OFF AT TOP, BOTTOM OR SIDES 
FADED TEXT 
ILLEGIBLE TEXT 
SKEWED/SLANTED IMAGES 
COLORED PHOTOS 

BLACK OR VERY BLACK AND WHITE DARK PHOTOS 
GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 

As rescanning documents will not correct images, 
please do not report the images to the 
Image Problems Mailbox. 




US006553027B1 



(12) United States Patent (10) Patent No.: US 6,553,027 Bl 

Lara et al. (45) Date of Patent: Apr. 22, 2003 



(54) APPARATUS AND METHOD FOR 

CASCADING MULTIPLE NETWORK 
SWITCH DEVICES 

(75) Inventors: Ian Lam, Daly City, CA(US); Eric 
( Tsin-Ho Leung, San Jose, CA (US) 

(73) Assignee: Advanced Micro Devices, Inc., 

Sunnyvale, CA (US) 

( * ) Notice: Subject to any disclaimer, the term of this 
patent is extended or adjusted under 35 
U.S.C. 154(b) by 0 days. 

(21) Appl. No.: 09/315,971 

(22) Filed: May 21, 1999 

(65) Prior Publication Data 

(65) 

(51) Int. CI. 7 H04Q 11/00; H04L 12/56 

(52) U.S. CI 370/386; 370/396 

(58) Field of Search 370/299, 354, 

370/356, 386, 388, 396, 398, 423, 395, 
258, 389, 218, 412, 360 

(56) References Cited 

U.S. PATENT DOCUMENTS 

5,412,653 A ♦ 5/1995 Hoppe et al 370/360 

5,515,376 A 5/1996 Murthy et al. 

5,542,048 A * 7/1996 Olnowich et al 395/200.15 

5,557,266 A * 9/1996 Calvignac et al 340/825.02 

5,821,875 A * 10/1998 Lee et al 370/352 

5,872,787 A * 2/1999 Cooperman et al 370/412 

5,909,564 A * 6/1999 Alexander et al 395/311 

5,999,518 A * 12/1999 Nattkemper et al 370/258 

6,026,088 A * 2/2000 Rostoker et al 370/395 



6,104,696 A * 8/2000 Kadambi et al 370/218 

6,115,387 A * 9/2000 Egbert et al 370/423 

6,128,654 A * 10/2000 Runaldue et al 709/219 

6,246,680 Bl * 6/2001 Muller et al 370/389 

6,289,021 Bl * 9/2001 Hesse 370/409 

6,295,281 Bl * 9/2001 Itkowsky et al 370/293 

6,317,429 Bl * 11/2001 Nakata et al 370/360 

6,335,938 Bl * 1/2002 Chiang et al 370/458 

6,405,258 Bl * 6/2002 Erimli et al 370/235 

6,463,032 Bl * 10/2002 Lau et al 370/218 

6,480,490 Bl * 11/2002 Merchant et al 370/389 

6,483,844 Bl * 11/2002 Erimli 370/428 

OTHER PUBLICATIONS 

Doganata, YN. "Effects of Cascading on the Performance of 
a Switching System". Global Telecommunications Confer- 
ence, 1992. pp. 1493-1497, vol. 3. Dec. 6-9, 1992.* 

* cited by examiner 

Primary Examiner — Hassan Kizou 
Assistant Examiner — Anh-Vu H Ly 

(57) ABSTRACT 
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arrangement in a packet switched network connects a plu- 
rality of multiport network switches which is in a circular, 
serial manner so that data is transferable between the net- 
work switches only unidirectionally. When it is determined 
that data is to be transmitted from a first network switch to 
a port in a second network switch, the data is transmitted 
over an expansion bus from the first network switch to the 
second network switch in a continuous stream of data bursts. 
This extremely fast transmission between the networks 
switches allows multiple multiport network switches to be 
cascaded together to effectively form a single network 
switch with at least twice as many ports. 
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APPARATUS AND METHOD FOR 
CASCADING MULTIPLE NETWORK 
SWITCH DEVICES 

FIELD OF THE INVENTION 

The present invention relates to computer network inter- 
facing and switching, and more particularly, to an apparatus 
and method for cascading multiple multiport network 
switches to increase the number of ports in a network 
switching arrangement. 

BACKGROUND ART 

Local area networks use a network cable or other media 
to link stations on a network. Each local area network 
architecture uses a media access control (MAC) enabling 
network interfaces at each station to share access to a 
medium. 

The Ethernet, protocol (IEEE Std. 802.3) defines a half- 
duplex media access format that permits all stations to 
access the network media channel with equality. Traffic is 
not distinguished or prioritized over the media. Each station 
includes an Ethernet interface that uses carrier-sense 
multiple-access with collision detection (CSMA/CD) to 
listen for traffic on the media. Any station can attempt to 
contend for the channel by waiting a predetermined trans- 
mission delay interval after the deassertion of the receive 
carrier on the media, known as the interpacket gap (IPG) 
interval. If a plurality of stations have data to send on the 
network, each of the stations will attempt to transmit in 
response to the sensed deassertion of the receive carrier on 
the media and after the IPG interval, resulting in a collision. 
Hence, a transmitting station will monitor the media to 
determine if there has been a collision due to another station 
sending data at the same time. If a collision is detected, both 
stations stop, wait a respective random amount of time, and 
retry transmission. 

A multiport network switch in a packet switching network 
is coupled to stations on the network through its multiple 
ports. Data sent by one station on a network to one or more 
other stations on the network are sent through the network 
switch. The data is provided to the network switch over a 
shared access medium according to the Ethernet protocol. 
The network switch, which receives the data at one of its 
multiple ports, determines the destination of the data frame 
from the information contained within the data frame. The 
network switch then transmits the data from the appropriate 
port to which the destination network station is connected. 

A single network switch may have a number of 10/100 
Mb/s ports, such as 12 ports. The use of a single network 
switch in the Ethernet network may limit the size and speed 
of the network. The number of end stations connected to the 
single network switch is limited by the number of ports of 
the network switch. 

Proposals to increase the size of the network by coupling 
two network switches together through one of the 10/100 
Mb/s ports allow data to be transferred from an end station 
connected to a first network switch to an end station con- 
nected to a second network switch. However, since each of 
the 10/100 Mb/s ports has a MAC for enabling the network 
interfaces at each station to share access to the medium, the 
transmission of data between the two end stations through 
the length between the network switches is relatively very 
slow. The data would have to be switched by the first 
network switch, queued and sent over the shared access 
medium to the second network switch, switched within the 
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second network switch and queued and sent out the correct 
port of the second network switch to the ultimate destination 
end station. Furthermore, the transmission rate at the net- 
work interface port is limited by the Ethernet protocol. Even 
s if the connection is through a gigabit port, the transmission 
rate between the network stations is limited by the use of the 
MAC and the transmission protocol to 1.0 Gb/sec. 

SUMMARY OF THE INVENTION 

10 There is need for an arrangement and method for cascad- 
ing a plurality of multiport network switches of a packet 
switched network in a manner that does not limit the 
transmission rate between the network switches, so as to 
provide an arrangement that more closely simulates a single 

15 network switch with an increased number of ports. 

These and other needs are met by embodiments of the 
present invention which provide a packet switched network 
switch arrangement having first and second packet switching 
network -O switches. A data connection is provided between 

20 the first and second network switches. A controller controls 
the transmission of data from the first network switch to the 
second network switch in a continuous stream of data bursts. 
One of the advantages of these embodiments of the 

25 present invention is the transmission of data between the 
switches in a continuous stream of data bursts. As stated 
earlier, according to typical Ethernet protocol, data is sent 
after waiting a predetermined transmission delay interval 
after deassertion of the receive carrier on the media, known 

3Q as the IPG interval. This is due to the shared nature of the 
transmission medium. Hence, the data is not sent in a 
continuous stream of data bursts. In the present invention, 
however, the continuous stream of data bursts provides a 
much faster transmission of data between the network 

35 switches. This fast transmission of data allows the two 
network switches to effectively serve as a single switch with 
twice the number of ports as either switch by itself. 

The earlier stated needs are met by other embodiments of 
the present invention which provide a multiport packet 

40 switched network switch arrangement comprising a first 
n-port network switch having an expansion port with a 
transmit side through which data is transmitted from the first 
network switch and a receive side through which data is 
received through which data is received with the first 

45 network switch. A second n-port network switch is provided 
having an expansion port with a transmit side through which 
data is transmitted from the second network switch and a 
receive side through which data is received at the second 
network switch. A first unidirectional expansion bus is 

50 coupled between the expansion port transmit side of the first 
network switch and the expansion port receive side of the 
second network switch for transmission of the continuous 
stream of data bursts. A second unidirectional bus is coupled 
between the expansion port transmit side of the second 

55 network switch and the expansion report receive side of the 
first network switch for transmission of a continuous stream 
of data bursts. 

The use of the unidirectional expansion buses between the 
expansion ports of first and second network switches pro- 
60 vides for fast transmissions of continuous streams of data 
bursts between the networks switches. Thus, the two end- 
port network switches may act as a single 2n-port network 
switch. 

The earlier stated needs are also met by another embodi- 
es ment of the present invention which provides a method of 
operating an m-port network switch on a packet switch 
network. The m-port network switch has q network 
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switches, each network switch having n-ports, such that employed. The exemplary system 10 is a packet switched 

qxn-m. The method comprises the steps of connecting the network, such as an Ethernet (IEEE 802.3) network. The 

networks switches in a circular, serial manner such that data packet switched network includes integrated multiport 

is transferable between the network switches only unidirec- switches (IMS) 12 that enable communication of data pack- 

tionally. It is determined in a first one of the network $ cts between network stations. The network may include 

switches that data is to be transmitted from a selected port network stations having different configurations, for 

of second one of the network switches. The data is retrieved example twelve (12) 10 megabit per second (Mb/s) or 100 

from a memory coupled to the first network switch. The data Mb/s network stations 14 (hereinafter 10/100 Mb/s) that 

is then transmitted from the first network switch to the send and receive data at a network data rate of 10 Mb/s or 

second network switch in a continuous stream of data bursts. 100 Mb/s, and a 1000 Mb/s (i.e., 1 Gb/s) network node 22 

The data is then transmitted from the selected port of the that sends and receives data packets at a network speed of 1 

second network switch. Gb/s. The gigabit node 22 may be a server, or a gateway to 

This method of operating an n-port network switch a high-speed backbone network. Hence, the multiport 

arrangement is able to operate at a very fast switching rate switches 12 selectively forward data packets received from 

since the data transmitted between network switches does the network nodes 14 or 22 to the appropriate destination 

not have to be sent on a shared transmission medium and 15 based upon Ethernet protocol. 

may be sent in a continuous stream of data bursts. Each multiport switch 12 includes a media access control 

Furthermore, since MAC s are not required i controlling the (MAC) mQ(MG 2Q ^ ixansmiis and receives data kets 

access to the medium between the network switches he fr h ^ h (pHy) transceivers 

transmission speed is limited only by the clock rate of the . 4 . , r , ' f , v , / t . . 

_/ r , J c ,\ * c a u. on 16 via respective reduced media independent interlaces 

expansion ports. For example, it 16 bits are transterred each 20 . - c r irrr on . . . , ^ , ... 

clock cycle, and the clock speed for transmitting the data ( RMII > 18 ^cording to IEEE 802.3u protocol Each multi- 

between the network switches is 75 MHz, the transmission P ort switch 12 also includes a ^S ablt 24 f° r »f fing 

rate is approximately 1.2 Gb/sec. This number is greater than and receiving data packets to and from a gigabit PHY 26 for 

the 1.0 Gb transmission rate available at the fastest 1.0 Gb transmission to the gigabit node 22 via a high speed network 

Ethernet protocol ports. By changing the clock rate to 83 2 5 medium 28 ■ 

MHz, as provided in preferred embodiments of the present Each 10/100 Mb/s network station 14 sends and receives 
invention, the transmission rate is increased to 1.33 Gb/sec. data packets to and from the corresponding multiport switch 
Hence, the transmission between the network switches is not 12 via a media 17 and according to either half-duplex or full 
limited by the use of MAC's and a shared transmission duplex Ethernet protocol. The Ethernet protocol ISO/IEC 
medium. 30 8802-3 (ANSI/IEEE Std. 802.3, 1993 Ed.) defines a half- 
Additional advantages and novel features of the invention duplex media access mechanism that permits all stations 14 
will be set forth in part in the description which follows and to access the network channel with equality. Traffic in a 
in part will become apparent to those skilled in the art upon half-duplex environment is not distinguished over the 
examination of the following or may be learned by practice medium 17. Rather, each half-duplex station 14 includes an 
of the invention. The advantages of the present invention 35 Ethernet interface card that uses carrier-sense multiple 
may be realized and attained by means of instrumentalities access wilh collision detection (CSMA/CD) to listen for 
and combinations particularly pointed m the appended tfajfic Qn ^ medk m q{ netWQrk tfaffic is 

c detected by sensing deassertion of a receive carrier on the 

BRIEF DESCRIPTION OF THE DRAWINGS media. Any station 14 having data to send will attempt to 

FIG. 1 is a block diagram of a packet switched network 40 access tne channel by waiting a predetermined time, known 

including a multiple switch according to an embodiment of as the interpacket gap interval (IPG), after deassertion of the 

the present invention. receive carrier on the media. If a plurality of stations 14 have 

FIG. 2 is a block diagram of a multiport switch of FIG. 1 . data to send on the network, each of the stations will attempt 

FIG. 3 is a block diagram illustrating in detail the switch- to transmit in response to the sensed deassertion of the 

ing subsystem of FIG. 2. 45 receive carrier on the media and after the LPG interval, 

FIG. 4 is a block diagram of an expansion port con- possibly resulting in a collision. Hence, the transmitting 

structed in accordance with an embodiment of the present station will monitor the media to determine if there has been 

invention. a collision due to another station sending data at the same 

FIG. 5 is a block diagram depicting in more detail the time. If a collision is detected, both stations stop, wait a 

interconnection of a plurality of network switches, in accor- 50 random amount of time, and retry transmission, 

dance with an embodiment in the present invention. The 10/100 Mb/s network stations 14 that operate in full 

FIG. 6 is an exemplary timing diagram of expansion port duplex mode send and receive data packets according to the 

signals in accordance with an embodiment of the present Ethernet standard IEEE 802.3u. The fall-duplex environ- 

invention. ment provides a two-way, point-to-point communication 

FIG. 7 is a block diagram depicting in more detail data 55 link enabling simultaneous transmission and reception of 

steering logic of the transmission side of the expansion port data P ackets between each link partner, i.e., the 10/100 Mb/s 

of FIG. 4, in accordance with an embodiment of the present network station 14 and the corresponding multiport switch 
invention. 

FIG. 8 is a block diagram depicting in more detail a Each multiport switch 12 is coupled to 10/100 physical 

receive module of the receive side of the expansion port of 6° layer (PHY) transceivers 16 configured for sending and 

FIG. 4, in accordance with an embodiment of the present receiving data packets to and from the corresponding mul- 

invention. liport sw * tcn 12 across a corresponding reduced media 

independent interface (RMII) 18. In particular, each 10/100 

DETAILED DESCRIPTION OF THE PHY transceiver 16 is configured for sending and receiving 

INVENTION 65 d ata p ac kets between the multiport switch 12 and up to four 

FIG. 1 is a block diagram of an exemplary system in (4) network stations 14 via the RMII 18. A magnetic 

which the present invention may be advantageously transformer 19 provides AC coupling between the PHY 
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transceiver 16 and the corresponding network medium 17. location (i.e., a frame pointer) from the free buffer queue 64, 

Hence, the RMII 18 operates at a data rate sufficient to and outputs the received data packet from the corresponding 

enable simultaneous transmission and reception of data receive FIFO to the external memory interface 44 for storage 

packets by each of the network stations 14 to the corre- ™ the external memory 36 at the location specified by the 

sponding PHY transceiver 16. 5 frame pointer. 

Each multiport switch 12 also includes an expansion port , ^ . IRC , 4 ° monitors (i.e. "snoops") the data bus to 

30 for transferring data between other switches according to determine the frame pointer value and the header informa- 

a prescribed protocol. Each expansion port 30 enables £ the received packet (including source destination, 

multiple multiport switches 12 to be cascaded together as a ™<* VL^N address information). The IRC 40 uses the 

separate backbone network. io header information to determine which MAC ports will 

™„ , . . - # , , %ui-»tu output the data frame stored at the location specified by the 

FIG. 2 is a block diagram of the multiport switch 12. The r . . ™ , . . r *u mr-Atw 

m * . , * . j • • !• ■ An frame pointer. The decision making engine (i.e., the IRC 40) 

multiport switch 12 contains a decision making engine 40 Aatom - tUnt n • fA „ A * tn * * *u u. ™,t«,,t 

. ^ , £ ,. , . . t * , may thus determine that a given data frame should be output 

tha performs frame forwarding decis.ons a switch mg sub- ' a port , 6 multiple portS) a u ports 

system 42 for transfernng frame data accordmg to toe frame J oa(Jcast) Qr ( 4*^. For le> V each 

forwarding decisions, an external memory interface 44, 13 , . c • i j » . . • j j *• *• 

& . . ' , / ao j data frame includes a header having source and destination 

management ^formation i base (MIB) counters 48a and 486 a makj en ^ e ^ idemif 

(collectively 48), and MAC (media access control) protocol ^ rfate out , MAC rt the destination 

interfaces 20 and 24 to support the routing of data packets MtttaUi}/el ^ destination ad dress may corre- 

between the Etherae (IEEE 802.3) prta anting the net- ^ > fa appropriate decision 

work stauons 14 and he gigab.t node 22 The MIB counters ^ identifles ^ ond ? P * , luralit of 

48 provide statistical network information in the form of .if*- t j JV *u * ■ 1 J 

r , . - . /wtt>\ w * . i network stations. In addition, the frame may include a 

management information base (MIB) objects, to an external T/T ANT , , , . ..' - J . f 

5 .... ii j l. u /oimtm j * VLAN tag header that identifies the frame as information 

management entity controlled by a host CPU 32, described , .. , ° , c , c 

s J 3 ' destined to one or more members of a prescribed group of 

e ow ' 25 stations. The IRC 40 may also determine that the received 

The external memory interface 44 enables external star- data packet shcnild be transferred t0 another multiport switch 

age of packet data in an external memory 36 such as, for u via the expansion port 30 . Hence, the internal rules 

example, a synchronous static random access memory chedcer ^ wiU dedde whemer a frame temporarily stored 

(SSRAM), in order to minimize the chip size of the multi- in the extemal memory 36 should be 01ltpiU to a single MAC 

port switch 12. In particular, the multiport switch 12 uses the 3o port or mulUple MAC ports . 

external memory 36 for storage of received frame data and ^ interna] ^ checker ^ Q a forwardin deci . 

memory structures. The external memory 36 ^ preferably ^ tQ ^ switch sub stem 42 in the form of a forwarding 

either a Joint Electron Device Engineering ; Council (JEDEC) descri tor ^ forwarding descriptor includes a priority 

pipelined burst or Zero Bus Turnaround™ (ZB^-SSRAM ^ ^ ntifying whethef ^ js ^ ^ ^ ^ 

having a 64-bit wide data path and a 17-bit W1 de address 35 priority, a port vector identifying each MAC port that should 

path. The external memory 36 is addressable as upper and {Tmsmii ^ dat& f receiye numb an d 

lower banks of 128K m 64-bit words. Tlie size of the informatioil) vector iden tifying each MAC port 

external memory 36 is preferably at least 1 Mbytes, with that should include VLAN information during transmission, 

data transfers possible on every clock cycle through pipe- d and frame inlef ^ formal of the fonvardi 

lining. Additionally the external memory interface clock ^ descriptor will discussed further with respect to FIG. 7. The 

operates at clock frequencies of at least 66 MHz, and, yector ideatifies ^ MAC tQ receiye ^ daU 

preferably, 83 MHz and above. frame for Emission (e.g., 10/100 MAC ports 1-12, 

The multiport switch 12 also includes a processing inter- Gigabit MAC portj and/or Expansi on port). The port vector 

face 50 that enables an external management entity such as FIF0 56 decodes the forwarding descriptor including the 

a host CPU 32 to control overall operations of the multiport 45 port vector> and t he frame pointer to the appropriate 

switch 12. In particular, the processing interface 50 decodes outpm queues 58 mat correspon d to the output MAC ports 

CPU accesses within a prescribed register access space, and to receive the data frame transmission. In other words, the 

reads and writes configuration and status values to and from port vector FIF0 56 S1]ppl i es the f ra me pointer on a per-port 

configuration and status registers 52. basis 0Tltput queues 58 gi ve the frame pointer to a 

The internal decision making engine 40, referred to as an 50 dequeuing block 76 (shown in FIG. 3) which fetches the data 

internal rules checker (IRC), makes frame forwarding deci- fr arne identified in the port vector from the external memory 

sions for data packets received. 36 via the external memory interface 44, and supply the 

The multiport switch 12 also includes an LED interface retrieved data frame to the appropriate transmit FIFO of the 

54 that clocks out the status of conditions per port and drives identified ports. If a data frame is to be supplied to a 

an external LED logic. The external LED logic drives LED 55 management agent, the frame pointer is also supplied to a 

display elements that are human readable. management queue 68, which can be processed by the host 

The switching subsystem 42, configured for implement- CPU 32 via the CPU interface 50. 

ing the frame forwarding decisions of the IRC 40, includes The multicopy queue 60 and the multicopy cache 62 keep 

a port vector first in first out (FIFO) buffer 56, a plurality of track of the number of copies of the data frame that are 

output queues 58, a multicopy queue 60, a multicopy cache 60 transmitted from the respective ports, ensuring that the data 

62, a free buffer queue 64, and a reclaim queue 66. frame is not overwritten in the external memory 36 until the 

The MAC unit 20 includes modules for each port, each appropriate number of copies of the data frame have been 

module including a MAC receive portion, a receive FIFO output from the external memory 36. Once the number of 

buffer, a transmit FIFO buffer, and a MAC transmit portion. copies output corresponds to the number of ports specified 

Data packets from a network station 14 are received by the 65 in the port vector FIFO 56, the frame pointer is forwarded 

corresponding MAC port and stored in the corresponding to the reclaim queue 66. The reclaim queue 66 stores frame 

receive FIFO. The MAC unit 20 obtains a free buffer pointers that need to be reclaimed and walks the linked list 
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chain to return the buffers to the free buffer queue 64 as free 
pointers. After being returned to the free buffer queue 64, the 
frame pointer is available for reuse by the MAC unit 20 or 
the gigabit MAC unit 24. 

FIG. 3 depicts the switch subsystem 42 of FIG. 2 in more 
detail according to an exemplary embodiment of the present 
invention. Other elements of the multiport switch 12 of FIG. 
2 are produced in FIG. 3 to illustrate the connections of the 
switch subsystem 42 to these other elements. 

As shown in FIG. 3, the MAC module 20 includes a 
receive portion 20a and a transmit portion 46. The receive 
portion 20a and the transmit portion 246 each include 12 
MAC modules (only two of each shown and referenced by 
numerals 70a, 706, 70c, and IQd) configured for performing 
the corresponding receive or transmit function according to 
IEEE 802.3 protocol. The MAC modules 70c and 70d 
perform the transmit MAC operations for the 10/100 Mb/s 
switch ports complementary to modules 70a and 706, 
respectively. 

The gigabit MAC port 24 also includes a receive portion 
24a and a transmit portion 246, while the expansion port 30 
similarly includes a receive portion 30a and a transmit 
portion 306. The gigabit MAC port 24 and the expansion 
port 30 also have receive MAC modules 72a and 726 
optimized for the respective ports. The transmit portions 246 
and 306 of the gigabit MAC port 24 and the expansion port 
30a also have transmit MAC modules 72c and 72d, respec- 
tively. The MAC modules are configured for full-duplex 
operation on the corresponding port, and the gigabit MAC 
modules 72a and 72c are configured in accordance with the 
Gigabit Proposed Standard IEEE Draft P802.3z. 

Each of the receive MAC modules 70a, 706, 72a, and 726 
include queuing logic 74 for transfer of received data from 
the corresponding internal receive FIFO to the external 
memory 36 and the rules checker 40. Each of the transmit 
MAC modules 70c, 70a 1 , 72c, and 72d includes a dequeuing 
logic 76 for transferring data from the external memory 36 
to the corresponding internal transmit FIFO, and a queuing 
logic 74 for fetching frame pointers from the free buffer 
queue 64. The queuing logic 74 uses the fetched frame 
pointers to store receive data to the external memory 36 via 
the external memory interface controller 44. The frame 
buffer pointer specifies the location in the external memory 
36 where the received data frame will be stored by the 
receive FIFO. 

The external memory interface 44 includes a scheduler 80 
for controlling memory access by the queuing logic 74 or 
dequeuing logic 76 of any switch port to the external 
memory 36, and an SSRAM interface 78 for performing the 
read and write operations with the external memory 36. In 
particular, the multiport switch 12 is configured to operate as 
a non-blocking switch, where network data is received and 
output from the switch ports at the respective wire rates of 
10, 100, or 1000 Mb/s. Hence, the scheduler 80 controls the 
access by different ports to optimize usage of the bandwidth 
of the external memory 36. 

Each receive MAC stores a portion of a frame in an 
internal FIFO upon reception from the corresponding switch 
port; the size of the FIFO is sufficient to store the frame data 
that arrives between scheduler time slots. The corresponding 
queuing logic 74 obtains a frame pointer and sends a write 
request to the external memory interface 44. The scheduler 
80 schedules the write request with other write requests from 
the queuing logic 74 or any read requests from the dequeu- 
ing logic 76, and generates a grant for the requesting 
queuing logic 74 (or the dequeuing logic 76) to initiate a 
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transfer at the scheduled event (i.e., slot). Sixty-four bits of 
frame data is then transferred over a write data bus 69a from 
the receive FIFO to the external memory 36 in a direct 
memory access (DMA) transaction during the assigned slot. 

s The frame data is stored in the location pointed to by the 
buffer pointer obtained from the free buffer pool 64, 
although a number of other buffers may be used to store data 
frames, as will be described. 

The rules checker 40 also receives the frame pointer and 

10 the header information (including source address, destina- 
tion address, VLAN tag information, etc.) by monitoring 
(i.e., snooping) the DMA write transfer on the write data bus 
69a. The rules checker 40 uses the header information to 
make the forwarding decision and generate a forwarding 

15 instruction in the form of a forwarding descriptor that 
includes a port vector. The port vector has a bit set for each 
output port to which the frame should be forwarded. If the 
received frame is a unicopy frame, only one bit is set in the 
port vector generated by the rules checker 40. The single bit 

20 that is set in the port vector corresponds to a particular one 
of the ports. 

The rules checker 40 outputs the forwarding descriptor 
including the port vector and the frame pointer into the port 
vector FIFO 56. The port vector is examined by the port 

25 vector FIFO 56 to determine which particular output queue 
should receive the associated frame pointer. The port vector 
FIFO 56 places the frame pointer into the top of the 
appropriate queue 58 and/or 68. This queues the transmis- 
sion of the frame. 

As shown in FIG. 3, each of the transmit MAC units 70c, 
70d, 12d, and 72c has an associated output queue 58a, 586, 
58c, and 5$d, respectively. In preferred embodiments, each 
of the output queues 58 has a high priority queue for high 

35 priority frames, and a low priority queue for low priority 
frames. The high priority frames are used for frames that 
require a guaranteed access latency, e.g., frames for multi- 
media applications or management MAC frames. The frame 
pointers stored in the FIFO -type output queues 58 are 

4Q processed by the dequeuing logic 76 for the respective 
transmit MAC units. At some point in time, the frame 
pointer reaches the bottom of an output queue 58, for 
example, output queue 58d for the gigabit transmit MAC 
72c. The dequeuing logic 76 for the transmit gigabit port 246 

45 takes the frame pointer from the corresponding gigabit port 
output queue 58a*, and issues a request to the scheduler 80 
to read the frame data from the external memory 36 at the 
memory location specified by the frame pointer. The sched- 
uler 80 schedules the request, and issues a grant for the 

5Q dequeuing logic 76 of the transmit gigabit port 246 to initiate 
a DMA read. In response to the grant, the dequeuing logic 
76 reads the frame data (along the read bus 696) in a DMA 
transaction from the location in external memory 36 pointed 
to by the frame pointer, and stores the frame data in the 

55 internal transmit FIFO for transmission by the transmit 
gigabit MAC 72c. If the forwarding descriptor specifies a 
unicopy transmission, the frame pointer is returned to the 
free buffer queue 64 following writing the entire frame data 
into the transmit FIFO. 

60 A multicopy transmission is similar to the unicopy 
transmission, except that the port vector has multiple bits 
set, designating the multiple ports from which the data frame 
will be transmitted. The frame pointer is placed into each of 
the appropriate output queues 58 and transmitted by the 

65 appropriate transmit MAC units 206, 246, and/or 306. 

The free buffer pool 64, the multicopy queue 60, the 
reclaim queue 66, and the multicopy cache 62 are used to 
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manage use of frame pointers and re -use of frame pointers 
once the data frame has been transmitted to its designated 
output port(s). In particular, the dequeuing logic 76 passes 
frame pointers for unicopy frames to the free buffer queue 64 
after the buffer contents have been copied to the appropriate 
transmit FIFO. 

For multicopy frames, the port vector FIFO 56 supplies 
multiple copies of the same frame pointer to more than one 
output queue 58, each frame pointer having a unicopy bit set 
to zero. The port vector FIFO 56 also copies the frame 
pointer and the copy count to the multicopy queue 60. The 
multicopy queue 60 writes the copy count to the multicopy 
cache 62. The multicopy cache 62 is a random access 
memory having a single copy count for each buffer in 
external memory 36 (i.e., each frame pointer). 

Once the dequeuing logic 76 retrieves the frame data for 
a particular output port based on a fetched frame pointer and 
stores the frame data in the transmit FIFO, the dequeuing 
logic 76 checks if the unicopy bit is set to 1. If the unicopy 
bit is set to 1, the frame pointer is returned to the free buffer 
queue 64. If the unicopy bit is set to zero indicating a 
multicopy frame pointer, the dequeuing logic 76 writes the 
frame pointer with a copy count of minus one (-1) to the 
multicopy queue 60. The multicopy queue 60 adds the copy 
count to the entry stored in the multicopy cache 62. 

When the copy count in multicopy cache 62 for the frame 
pointer reaches zero, the frame pointer is passed to the 
reclaim queue 66. Since a plurality of frame pointers may be 
used to store a single data frame in multiple buffer memory 
locations, the frame pointers are referenced to each other to 
form a linked-list (i.e., chain) of frame pointers to identify 
the stored data frame in its entirety. The reclaim queue 66 
traverses the chain of buffer locations identified by the frame 
pointers, and passes the frame pointers to the free buffer 
queue 64. 

The foregoing description of the switch architecture pro- 
vides an overview of the switch operations in a packet 
switched network. A more detailed description of the fea- 
tures of the present invention as embodied in the multiport 40 
switch 12 will now be provided. First, the architecture of an 
exemplary expansion port 30 will be discussed, followed by 
the details for transferring data between switches 12. 



30 



35 



FIG. 



Expansion Port 
4 illustrates an exemplary block diagram of an 



expansion port 30 briefly described earlier. The expansion 
port provides connections to other network switches to allow 
the cascading of multiple network switches to increase the 
number of 10/100 Mb/s ports beyond twelve, the number of 
ports within a single network switch. The expansion port 30 
is enabled when a cascade mode bit is set within the switch 
information register 52 (see FIG. 2). In this mode, the 
expansion port transmit signals are connected to the expan- 
sion port receive signals of the next device in a cascade ring 
that is formed, as depicted schematically in FIG. 1. FIG. 5 
depicts in more detail the expansion port interconnections 
among three network switches, 12a, 12b and 12c. The 
transmit signals of switch 12a are connected by unidirec- 
tional expansion bus 120a to the receive signals of the 
second network switch in the cascade ring. Expansion bus is 
a 17 bit wide bus, in preferred embodiments of the present 
invention. Sixteen of these bits are for transmitting data, and 
a seventeenth bit is used for transmitting an information 
signal, as will be described later. As can be seen from FIG. 
5, the network switches 12a, 126 and 12c are connected in 
a cascade ring fashion so that data flows in only one 
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direction through the ring. Hence, the first network switch 
12a may transmit data only to the second network switch 
12b, and not directly to the third network switch 12c. 
However, if data is to be transmitted from a port in 12c, the 
network switch 12a may send that data through the second 
network switch 12b and then to the third network switch 
12c. The expansion buses 120a, 120b and 120c therefore 
carry the 16 bit wide data signal ETXD and the one bit-wide 
information signal ETX_INTO. The clock signal ETX_ 
CLK and receive ERX^CLK is at 83 MHz in the exemplary 
embodiment. However, by increasing or decreasing the 
clock rate, the effective transmission rate between the net- 
work switches is increased or decreased. 

As will be explained in more detail later with respect to 
the timing diagram of FIG. 6, the strobe signal ETX_SB is 
asserted by the transmitting network switch 12 before it 
begins transmitting a burst of data. The expansion port 
transmitter can send data any time that ETX_GNT is 
asserted by the downstream network switch. This indicates 
that space is available in the receive FIFO of the downstream 
network switch. If the ETX__GNT signal is deasserted 
during a data transfer, the transmitter pauses at the end of the 
eight clock burst and resumes transmission when ETX_ 
GNT is asserted again. However, as long as ETX_GNT 
remains asserted, there will not be any pauses between 
bursts of data so that the data will be transferred in a 
continuous stream. 

The block diagram of FIG. 4 depicting the exemplary 
embodiment of expansion port 30 includes a number of 
different modules within the expansion port 30. The expan- 
sion port dequeuing block EP_DQ 100 interacts with the 
dequeuing logic depicted in FIG. 3 for the expansion port 30. 
The expansion port queuing block EP_QU 104 that inter- 
acts with the queuing logic is also depicted in FIG. 3. 

The external memory module EP_XM 102 interacts with 
external memory 36a and temporarily stores the data 
retrieved from the external memory 36a through the expan- 
sion part dequeuing logic block EPDQ 100. It includes a 
random access memory (RAM) that is the same size as a 
receive FIFO in preferred embodiments, A transmit module 
EP„TX 108 retrieves the data to be transmitted from the 
transmit module EP„XM 102 and presents them in bursts 
on the expansion bus in a 16-bit wide burst. The transmit 
module EP_TX 108 includes a transmit FIFO in certain 
embodiments. The modules EP_DQ 100, EP_XM 102 and 
EP_TX 108 together form the transmit side of the expan- 
sion port 30. 

The receive side of the expansion port 30 is formed by the 
queuing logic EP„QU 104, the receive memory logic 
EP_RM 106, and the EP_RX logic 110. The data received 
from another network switch is first received at the EP__RX 
logic block 110, which includes a receive FIFO that may be 
134 entries long and 18 bits wide, for example. The received 
information is transferred to the RAM of the EP_RM block 
106. The EP_RM 106 block acts as a basic FIFO control 
and includes a FIFO that has 134 entries that are 18 bits wide 
and is a dual-port RAM. The received data from the EP_RM 
106 is then provided to the queuing logic through the 
queuing block EP_QU 104. 

FIG. 7 depicts data steering logic within the EP_TX 
block 108. A multiplexer 130 receives the data as signals 
EP_TX data from the EP_XM module 102. The transmit 
data is then provided to the expansion bus through a D flip 
flop 132 as signal EP_IO_ETXD [15:0], A D flip flop is 
clocked by a 83 MHz clock, CLK 83. This clock signal is 
also provided as a signal to the network switch as a signal 
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EP_10„ETX__CLK. The transfer count, TRANSFER^ 
COUNT [3:0] is a signal that selects which data is being 
provided from the multiplexer 130 to the D flip flop 132 for 
transmission. The transfer count starts counting when the 
start .of frame (SOF) is asserted. 

A block diagram of the receive module EP_RX 110 is 
depicted in an exemplary embodiment of FIG. 8. The 
module contains a plurality of multiplexers 140 coupled 
with latches 142 arranged to receive the 16 -bit wide data on 
the expansion bus 120. The EP_RX module 110 gathers the 
16-bit wide data together in the D flip flops 142 and forms 
a signal EP_RF_data [133:0] that is provided to the RAM 
serving as a receive FIFO within the EP_RM block 106. 

When data comes into one of the 10/100 Mb/s ports in one 
of the network switches, for example, and switch 12a (see 
FIG. 5) and the logic within the switch, such as the IRC 40, 
determines that the data needs to be sent to an end station 
connected to a port in switch 12b, the expansion port 30 is 
provided with the frame pointer for that frame. The data for 
that frame has been stored within the external memory 
SSRAM 36ot as described earlier in the general operation of 
the switch. The EP_DQ block 100 of the expansion port 
(FIG. 4) provides a write enable and obtains the data from 
the external memory, SSRAM 36a. This data is provided 
into the dual port RAM within the EP_XM block 102. A 
signal FIF0__COUNT counts the number of entries in the 
dual port RAM and inserts an EMPTY and FULL flag 
accordingly. With data ready to send, and temporally buff- 
ered in the transmit FIFO buffer (the dual port RAM within 
the EP_XM), it is determined whether the expansion port 30 
within the receiving network switch 126 has the capacity to 
receive the data. If the FIFO„COUNT in the receive 
memory block EP_RM 106 of the expansion port 30 in the 
second network switch 12b indicates that the receive FIFO 
is not full, the receive FIFO is considered to have the 
capacity to store the data from the transmitting FIFO of the 
first network switch 12a. The EP_RM block 106 of the 
second network switch 102 therefore sends a EPIO_ERX_ 
REQ signal to the first network switch 12a to indicate that 
it currently has capacity to receive the data. 

In response to the receipt of the EP IO_ERX_REQ 

signal from the second network switch 12b (received as an 
incoming signal IO_EP_ETX__GNT), the transmitting net- 
work switch 12a asserts the ETX__SB signal. This strobe 
signal informs the receiving network switch 12b that a burst 
of a data will be following one cycle after the assertion of the 
ETX__SB signal. 

Referring to FIG. 6, depicting an exemplary expansion 
port timing diagram, the 83 MHz clock ETX^CLK is 
depicted at the top of the diagram. The strobe signal ETX_ 
SB is strobed by the transmitting expansion port 30 of the 
first network switch 12a. The data is then transmitted as 16 
bits every clock cycle, as signals EXTD [7:0] and EXTD 
[15:8]. The data is transmitted over the expansion bus 120a. 

At the same time as the 16 bits of data are transferred, an 
information signal is also transmitted on the expansion bus 
120a by the expansion port 30 of the transmitting network 
switch 12a. This information signal, ETX_INFO, is a 
one-bit signal. The first four bits transmitted of the infor- 
mation signal indicate the number of bits of the frame that 
are valid. This portion of the information signal, BE [3:0], is 
transmitted as a four bit signal, one bit in each of the first 
four clock cycles. In the fifth clock cycle of the data bursts, 
a start of frame bit (SOF) is sent. This SOF bit, when set, 
indicates that this burst is the start of a frame. In the sixth 
clock cycle, an end of frame bit (EOF) is sent. The EOF bit, 
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when set, indicates that this burst contains the end of the 
frame. As an example, if the final burst of frame data 
contains 13 bits of frame data, the value of the 6 bits 
transferred on the ETX„INFO pin would be: BE[3:0]= 

s 1101; SOF«0; and EOF=l. The final two bits of the ETX_ 
INFO signal are always zeros. 

As shown in dotted lines in clock cycle 9, if another 
ETX_SB signal is asserted, a second eight clock burst 
occurs without any dead time. 

10 The continuous stream of data bursts provided through the 
expansion port and the method of operation as described 
above allows the transferred data between network switches 
to occur much faster than over a shared medium. The rate 
transfer may be speeded up even further by merely changing 

15 the clock signal ETX_CLK. There are no interpacket gaps 
between data bursts, as is conventionaly with data transfers 
employing media access controllers (MACs on a shared 
medium). 

With the extremely fast transfer (e.g. 1.3 Gb/sec at 83 
20 MHz) two 12-port network switches may be cascaded 
together to effectively form a single 24-port network switch. 
Similarly, three 12 port switches may be cascaded to form a 
signal 36-port switch, and so on. The present invention thus 
provides expandability and modularity in the formation of a 
25 packet switched network, without incurring extensive 
switching delays when data is transmitted between ports on 
different switches. 
While this invention has been described with what is 
30 presently considered to be the most practical preferred 
embodiments, it is to be understood that the invention is not 
limited to the disclosed embodiments, but, on the contrary, 
is intended to cover various modifications and equivalent 
arrangements included within the spirit and scope of the 
35 appended claims. 

What is claimed is: 

1. A packet switched network switch arrangement com- 
prising: 

first and second network switches configured to switch 
40 packets; 

a data connection between the first and second network 
switches, the data connection being a unidirectional 
transmission medium; and 
a controller in each of the first and second network 
45 switches that controls transmission of data from the 
first network switch to the second network switch in a 
continuous stream of data bursts, wherein 
each of the first and second network switches includes an 
expansion port that comprises: 
50 the corresponding controller, 

a transmit first in, first out (FIFO) buffer for buffering 
data to be transmitted to another network switch, and 
a receive FIFO buffer for buffering data received from 
the other network switch. 
55 2. The arrangement of claim 1, wherein the controller in 
said each of the first and second network switches operates 
at a determined clock speed, with the transmission rate of the 
data being directly related to the clock speed. 

3. The arrangement of claim 2, wherein each of the 
60 network switches is an n-port multiport switch, and the 

arrangement effectively provides a 2n-port multiport switch. 

4. The arrangement of claim 3, wherein each unidirec- 
tional transmission medium is an m-bit wide expansion bus. 

5. The arrangement of claim 4, wherein the controller in 
65 said each of the first and second network switches comprises 

transmit grant signal generation logic for generating a trans- 
mit grant signal indicating the capability of a receiving one 
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of the network switches to receive data from a transmitting 
one of the network switches. 

6. The arrangement of claim 5, wherein the indicated 
capability in the transmit grant signal is a function of a 
current capacity of the receive FIFO buffer of the receiving 
one of the network switches. 

7. The arrangement of claim 6, wherein the controller in 
said each of the first and second network switches includes 
transmit logic responsive to a received transmit grant signal 
to initiate transmission of the continuous stream of data 
bursts when the received transmit grant signal indicates the 
receive FIFO buffer of the receiving one of the network 
switches currently has capacity to buffer a certain number of 
data bursts. 

8. The arrangement of claim 7, wherein the data bursts are 
16 bits wide and 8 clock cycles long, and the number of data 
bursts in the continuous stream of data bursts is 8. 

9. The arrangement of claim 8, wherein the controller in 
said each of the first and second network switches further 
includes information signal generation logic that generates 
an information signal transmitted with the data bursts. 

10. The arrangement of claim 9, wherein the information 
signal contains information indicating the number of bytes 
in each data burst that are valid. 

11. The arrangement of claim 10, wherein the information 
signal further contains information that indicates whether a 
data burst contains a start of a frame, and whether a data 
burst contains an end of a frame. 

12. The arrangement of claim 11, wherein m is 17, and the 
information signal is transmitted on the expansion bus as a 
single bit wide signal. 

13. The arrangement of claim 12, further comprising a 
third network switch serially connected to the second net- 
work switch by another data connection and to the first 
network switch by still another data connection, the third 
network switch being configured to switch packets, and each 
other data connection being a unidirectional transmission 
medium with data being transmitted unidirectionally from 
the first network switch to the second network switch, from 
the second network switch to the third network switch, and 
from the third network switch to the first network switch. 

14. The arrangement of claim 1, further comprising a third 
packet switching network switch serially connected to the 
second network switch by another data connection and to the 
first network switch by still another data connection, the 
third network switch being configured to switch packets, and 
each other data connection being a unidirectional transmis- 
sion medium with data being transmitted unidirectionally 
from the first network switch to the second network switch, 
from the second network switch to the third network switch, 
and from the third network switch to the first network 
switch. 

15. Amultiport packet switched network switch arrange- 
ment comprising: 

a first n-port network switch having an expansion port 
with a transmit side through which data is transmitted 
from the first network switch and a receive side through 
which data is received at the first network switch; 

a second n-port network switch having an expansion port 
with a transmit side through which data is transmitted 
from the second network switch and a receive side 
through which data is received at the second network 
switch; 

a first unidirectional expansion bus coupled between the 
expansion port transmit side of the first network switch 
and the expansion port receive side of the second 
network switch for transmission of a continuous stream 
of data bursts; 
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a second unidirectional expansion bus coupled between 
the expansion port transmit side of the second network 
switch and the expansion port receive side of the first 
network switch for transmission of a continuous stream 
of data bursts, wherein 

each network switch has an expansion port controller, a 
transmit first in (FIFO) buffer for buffering data to be 
transmitted to another one of the network switches, and 

a receive FIFO buffer for buffering data received from 
another one of the network switches. 

16. The arrangement of claim 15, further comprising a 
third n-port network switch interposed between the expan- 
sion port transmit side of the second network switch and the 
expansion port receive side of the first network switch, the 
third network switch having an expansion port with a 
transmit side through which data is transmitted from the 
third network switch and a receive side through which data 
is received at the third network switch; and 

a third unidirectional expansion bus connected between 
the expansion port transmit side of the third network 
switch and the expansion port receive side of the first 
network switch for transmission of a continuous stream 
of data bursts, wherein the second unidirectional 
expansion bus is connected between the expansion port 
transmit side of the second network switch and the 
expansion port receive side of the third network switch 
for transmission of a continuous stream of data bursts. 

17. The arrangement of claim 16, wherein the expansion 
port controller comprises transmit grant signal generation 
logic for generating a transmit grant signal indicating the 
capability of a receiving one of the network switches to 
receive data from a transmitting one of the network 
switches. 

18. The arrangement of claim 17, wherein the indicated 
capability in the transmit grant signal is a function of a 
current capacity of the receive FIFO buffer of the receiving 
one of the network switches. 

19. The arrangement of claim 18, wherein the expansion 
port controller includes transmit logic responsive to a 
received transmit grant signal to initiate transmission of the 
continuous stream of data bursts when the received transmit 
grant signal indicates the receive FIFO buffer of the receiv- 
ing one of the network switches currently has capacity to 
buffer a certain number of data bursts. 

20. The arrangement of claim 19, wherein the data bursts 
are 16 bits wide and 8 clock cycles long, and the number of 
data bursts in the continuous stream of data bursts is 8. 

21. The arrangement of claim 20, wherein the certain 
number of data bursts is 8. 

22. The arrangement of claim 21, wherein the controller 
further includes information signal generation logic that 
generates an information signal transmitted with the data 
bursts. 

23. The arrangement of claim 22, wherein the information 
signal contains information indicating the number of bytes 
in each data burst that are valid. 

24. The arrangement of claim 23, wherein the information 
signal further contains information that indicates whether a 
data burst contains a start of a frame, and whether a data 
burst contains an end of a frame. 

25. The arrangement of claim 24, wherein each expansion 
bus is 17 bits wide, and the information signal is transmitted 
on the expansion bus as a single bit wide signal. 

26. A method of operating an m-port network switch on 
a packet switched network, the m-port network switch 
having q network switches, each network switch having n 
ports, such that qxn-m, the method comprising the steps of: 
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connecting the network switches in a circular, serial 

manner such that data is transferable between the 

network switches only unidirectionally; 
determining in a first one of the network switches that data 

is to be transmitted from a selected port of a second one 5 

of the network switches; 
retrieving the data from a memory coupled to the first 

network switch; 
transmitting the data from the first network switch to the 

second network switch in a continuous stream of data 

bursts; and 

transmitting the data from the selected port of the second 

network switch, wherein 
each network switch has an expansion port through which 15 

data is transmitted and received between the other 

network switches, the expansion ports including 

a controller, 

a transmit FIFO for buffering data to be transmitted to 
another one of the network switches, and 20 

a receive FIFO for buffering data received from another 
one of the network switches. 
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27. The method of claim 26, further comprising generat- 
ing at each network switch a transmit grant signal indicating 
the capability of the network switch to receive data from 
another network switch. 

28. The method of claim 27, wherein the indicated capa- 
bility is a function of a current capacity of the receive FIFO 
of the network switch. 

29. The method of claim 28, further comprising initiating 
transmission of the continuous stream of data bursts by the 
first network switch when the first network switch is ready 
to transmit data from its transmit FIFO and receives a 
transmit grant signal indicating that the receive FIFO of the 
second network switch currently has capacity to buffer a 
certain number of data bursts. 

30. The method of claim 29, further comprising transmit- 
ting an information signal with the continuous stream of data 
bursts, wherein the information signal contains information 
indicating the number of bytes in each data burst that are 
valid, and whether a data burst contains a start of frame, and 
whether a data burst contains an end of frame. 

31. The method of claim 30, wherein q is greater than 2. 

***** 
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